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Abstract 

We propose a stability analysis method for sampled-data switched linear systems with finite-level 
static quantizers. In the closed-loop system, information on the active mode of the plant is transmitted 
to the controller only at each sampling time. This limitation of switching information leads to a mode 
mismatch between the plant and the controller, and the system may become unstable. A mode mismatch 
also makes it difficult to find an attractor set to which the state trajectory converges. A switching 
condition for stability is characterized by the total time when the modes of the plant and the controller 
are different. Under the condition, we derive an ultimate bound on the state trajectories by using a 
common Lyapunov function computed from a randomized algorithm. The switching condition can be 
reduced to a dwell-time condition. 


I. Introduction 

The recent advance of networking technologies makes control systems more flexible. However, 
the use of networks also raises new challenges such as packet dropouts, variable transmission 
delays, and real-time task scheduling. Switched system models provide a mathematical frame¬ 
work for such network properties because of their versatility to include both continuous flows 
and discrete jumps; see [3], [16], [30], [41] and references therein for the application of switched 
system models to networked control systems. 


This work was supported in part by The Kyoto University Foundation. The material in this paper was partially presented at 
the 19th IFAC World Congress, August 24-29, 2014, South Africa. 

M. Wakaiki is with the Center for Control, Dynamical-systems and Computation (CCDC), University of California, Santa 
Barbara, CA 93106-9560 USA (e-mail: masashiwak;aiki@ece. ucsb. edu). Y. Yamamoto is with the Department of 
Applied Analysis and Complex Dynamical Systems, Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan 
(e-mail: yy@i . kyoto-u . ac. jp). 



On the other hand, many eontrol loops in a praetieal network eontain ehannels over whieh 
only a finite number of bits can be transmitted. We need to quantize data before sending them out 
through a network. Therefore the effect of data quantization should be taken into consideration 
to achieve stability and desired performance. In addition to the practical motivation, literature 
such as [25], [27], [31], [35] has answered the theoretical question of how much information is 
necessary/sufficient for a given control problem. 

Switched systems and quantized control have been studied extensively but separately; see, 
e.g., [12], [17], [29] for switched systems and [10], [21], [26] for quantized control. However, 
quantized control of switched systems has received increasing attention in recent years. For 
discrete-time Markovian jump linear systems, control problems with limited information have 
been studied in [18], [19], [24], [36], [37]. Also, our previous work [34] has investigated 
the output feedback stabilization of continuous-time switched systems under a slow-switching 
assumption. In most of the above studies, the switching behavior of the plant is available to the 
controller at all times. 

In contrast, in sampled-data switched systems with quantization, the controller receives the 
quantized measurement and the active mode of the plant only at each sampling time. Since the 
controller side does not know the active mode of the plant between sampling times, we do not 
always use the controller mode consistent with the plant mode at the present time. The closed- 
loop system may therefore become unstable when switching occurs between sampling times. 
Moreover, for the stability of quantized systems, it is important to obtain regions to which the 
state belongs. However, mode mismatches yield complicated state trajectories, which make it 
difficult to find such regions. 

Stabilization of sampled-data switched system with dynamic quantizers has been first addressed 
in [13], which has proposed an encoding strategy for state feedback control. This encoding 
method has been extended to the output feedback case [32] and to the case with disturbances 
[39]. A crucial ingredient in the dynamic quantization is a reachable set of the state trajectories 
through sampling intervals. Propagation of reachable sets is used to set the quantization values at 
the next sampling time, and the dynamic quantizer achieves increasingly higher precision as the 
state approaches the origin. On the other hand, we study the stability analysis of sampled-data 
switched systems with finite-level static quantizers. For such a closed-loop system, asymptotic 
stability cannot be guaranteed. The objective of the present paper is therefore to find an ultimate 



bound on the system trajeetories as in the single-modal ease, e.g., [4], [5], [8], [9]. Since frequent 
mode mismatches make the trajectories diverge, a certain switching condition is required for the 
existence of ultimate bounds. 

As in [20] for switched systems with time delays, we here characterize switching behaviors by 
the total time when the controller mode is not synchronized with the plant one, which we call the 
total mismatch time. We derive a sufficient condition on the total mismatch time for the system 
to be stable, by using an upper bound on the error due to sampling and quantization. Moreover, 
an ultimate bound on the state trajectories is obtained under the switching condition. For the 
stability analysis, we use a common Lyapunov function that guarantees stability for all individual 
modes in the non-switched case. We find such Lyapunov functions in a computationally efficient 
and less conservative way by combining the randomized algorithms in [8], [15] together. 

From the total mismatch time, we can obtain an asynchronous switching time ratio. If the 
controller mode is synchronized with the plant one, then the closed-loop system is stable. 
Otherwise, the system may be unstable. Hence the total mismatch time is a characterization 
similar to the total activation time ratio [40] between stable modes and unstable ones. The crucial 
difference is that the unstable modes we consider are caused by switching within sampling 
intervals. Using the dependence of the instability on the sampling period, we can reduce the 
switching condition on the total mismatch time to a dwell-time condition, which is widely 
used for the stability analysis of switched systems. In Section 4, we will discuss in detail the 
relationship between the total mismatch time and the dwell time of switching behaviors. 

This paper is organized as follows. In Section 2, we present the closed-loop system, the 
information structure, and basic assumptions. In Section 3, we first investigate the growth rate 
of the common Lyapunov function in the case when switching occurs in a sampling interval. Next 
we derive an ultimate bound on the state, together with a sufficient condition on switching for 
stability. Section 4 is devoted to reduce the derived switching condition to a dwell-time condition. 
We illustrate the results through a numerical example in Section 5. Finally, concluding remarks 
are given in Section 6. 

This paper is based on a conference paper [33]. In the conference version, some of the proofs 
were omitted due to space limitations. The present paper provides complete results on the stability 
analysis in addition to an illustrative numerical example. We also made structural improvements 
in this paper. 



Notation 

We denote by Z+ the set of non-negative integers {fc G Z : A; > 0}. For a set C M", Cl (f2), 
Int (f2), and d^l are its elosure, interior, and boundary, respeetively. For sets fli, let \ 
be the relative eomplement of f 22 in fli, i.e., fli \ f 22 := ^ ^ 21 - 

Let M~^ denote the transpose of a matrix M G The Euelidean norm of a vector w G M" 

is defined by ||u|| := {v ^For a matrix M G its Euclidean induced norm is defined 

by ||M|| := sup{||Mn|| : v G M", 11^11 = 1}. Let Amax(-P) and Amin(P) denote the largest and 

the smallest eigenvalue of a square matrix P G Let B{L) be the closed ball in M" with 

center at the origin and radius L, that is, B{L) ;= {x G M" : ||x|| < L}. 

Let Tg be the sampling period. For f > 0, we define [f]“ by 

[t]~ := kTg if kTg < t < {k + l)Ts {k G Z+). 

IF Sampled-data Switched Systems with Quantization 

A. Switched systems 

Consider the following continuous-time switched linear system 

X = A„x + B„u, (1) 

where x{t) G M" is the state and u{t) G is the control input. For a finite index set V, 
the mapping a : [0, cxd) — j- P is right-continuous and piecewise constant, which indicates the 
active mode a{t) G "P at each time f > 0. We call a a switching signal, and the discontinuities 
of a switching times or simply switches. The plant sends to the controller the state x and the 
switching signal a. 

The first assumption is stabilizability of all modes. 

Assumption 2.1: For every mode p gV, {Ap, Bp) is stabilizable, i.e., there exists a feedback 
gain Kp G such that Ap -f BpKp is Hurwitz. 

B. Quantized sampled-data system 

Consider the closed-loop system in Fig. Let T* > 0 be the sampling period. The sampler 
St„ is given by 

St, : {x,a) hG {x{kTs),a{kTs)) {k G Z+), 


and the zero-order hold Ht^ by 


Hts ■ Ud^u{t) =Ud{k), t e [kTs, {k + 1)TJ {k e Z+). 


The second assumption is that at most one switch happens in each sampling interval. 
Assumption 2.2: Every sampling interval {kTg, {k + l)Ts) has at most one switch. 


See Remark 2.5 (3) below for the reason why we need this switching assumption. 

We now state the definition of a memoryless quantizer Q given in [8]. For an index set S, 
the partition {Qj}j^s of is said to he finite if for every bounded set B, there exists a finite 
subset Sf of S such that B C Uje*S/ define the quantizer Q with respect to the finite 

partition {Qj}je-s by 

Q : M" —)■ {qj}jes C M" 

X ^ qj if X e Qj {j G iS). 


As in [11], [14], we assume that Q{x) = 0 if x is close to the origin: 

Assumption 2.3: If Cl(Qj) contains the origin, then the corresponding quantization value 

qj = 0 . 

Let qx be the output of the zero-order hold whose input is the quantized state at sampling 
times, i.e., qx{t) = Q(x([f]“)). Note that in Fig. the control input u is given by 

u{t) = K^^[t]-)qx{t). (2) 



Fig. 1: Sampled-data switched system with quantization, where Tg is the sampling period and 
St^, Ht^, and Q are a sampler, a zero-order hold, and a static quantizer, respectively. 














The control input m is a piecewise-constant and discrete-valued signal. If we assume that a finite 
subset Sf of S satisfies x{t) e Uje*S/ Qj every state trajectory x{t), then data is transmitted 
to/from the controller at the rate of 

log2 \<Sf\ + log2 1^1 

T. 

bits per time unit, where \Sf\ and \V\ are the numbers of elements in 5/ and V, respectively. 

Let P G be positive definite and define the quadratic Lyapunov function V{x) := x^Px 
for a: G M". Its time derivative V along the trajectory of ([T]) with Q is given by 

Px{t) 

+ x{tY P{A„^t)x{t) + ( 3 ) 

if t is not a switching time or a sampling time. 

For p,q eV with p ^ q, we also define Vp and Vp^q by 

Vp{x{t),qYt)) := {Apx{t) + BpKpqYt)YPx{t) -f x{tYP{Apx{t) + BpKpqYt)) 

VpYx{t),qx{t)) := {Apx{t) + BpKqqYt)YPx{t) + x{tYP{Apx{t) + BpKgqYt))- (4) 

Then Vp and Vp^g are the time derivatives of V along the trajectories of the systems {Ap, BpKp) 
and (Ap, BpKq), respectively. 

Every individual mode is assumed to be stable in the following sense with the common 
Lyapunov function V: 

Assumption 2.4: Consider the following quantized sampled-data systems with ‘a single mode’: 

X = ApX + BpU, u = Kpq^ (p G P). (5) 

Let C be a positive number and suppose that R and r satisfy P > r > 0. Then there exists a 
positive-definite matrix P G such that for all p E V, every trajectory x of the system ([^ 
with a;(0) G Sp{R) satisfies 

Y{x{t),qYt)) <-C\\x{t)Y ( 6 ) 

or x{t) G ^p(r) for all f > 0, where Sp{R) and ^p(r) are given by 

Sp{R) := {x G M" : V{x) < P'A„ax(P)} 

Sp{r) := {x G M" : V{x) < r^X^YP)}- 



Assumption |2.4| implies the following: If we have no switehes, then the eommon Lyapunov 
function V exponentially decreases at a certain rate until V < r^Amm(-P) for every mode p G V. 
Furthermore, the trajectory does not leave £p{r) as well as £p{R) once it falls into them. 

The objective of the present paper is to find a switching condition under which every trajectory 
of the switched system in Fig. falls into some neighborhood of the origin and remains in the 
neighborhood. We also determine how small the neighborhood is. 

Remark 2.5: (1) The ellipsoid £p{R) is the smallest level set of V containing B{R), whereas 
£p{r) is the largest level set of V contained in B{r). 

(2) For switched systems without samplers, the existence of common Lyapunov functions is a 
sufficient condition for stability under arbitrary switching; see, e.g., [12], [17], [29]. For sampled- 
data switched systems, however, such functions do not guarantee stability because switching 
within a sampling interval may make the closed-loop system unstable. 

(3) Not only sampling but also quantization makes the stability analysis complicated. In fact. 


Assumption 2.4 does not consider trajectories after a switch even without a mode mismatch. 
For example, suppose that the mode changes p —)■ g —)■ p at the switching times R and t 2 in a 
sampling interval (0,Ts). Although the modes coincide between the plant and the controller in 
\t 2 ,Ts), ® holds only for t G (0,fi). This is because the trajectory in [t 2 ,Ts) does not appear 
for systems with a single mode. In Assumption |2.2[ we therefore assume that at most one switch 
occurs in a sampling interval, and hence @ holds whenever the modes coincide. If we consider 
trajectories in the worst case, then the switching condition in Assumption |2.2| can be removed. 
However, the stability analysis becomes more conservative and involved. 

(4) For quantized sampled-data plants with a single mode, the authors of [8] have proposed 


a randomized algorithm for the computation of P in Assumption 2.4 On the other hand, for 
switched systems without sampler or quantizer, the authors of [15] have developed a randomized 
algorithm to construct common Lyapunov functions. Combining these algorithms together, we 
can efficiently compute the desired common Lyapunov function. See Appendix B for details of 
the randomized algorithm. 







III. Stabilization with Limited Information 


A. Upper bound on Vp^q 


Assumption 2.4 gives an upper bound @ on Vp, i.e., the deereasing rate of the Lyapunov 
funetion in the ease when we use the feedbaek gain eonsistent with the eurrently aetive mode 
of the plant. In this subseetion, we will find an upper bound on Vp^q, i.e., the growth rate in the 
ease when intersample switehing leads to the mismateh of the modes between the plant and the 
feedbaek gain. More speeifieally, the aim here is to obtain D > 0 satisfying 


Vp,q{x{t),q^{t)) < D\\x{t)f 


(7) 


Let ga;(f) — x{t) is the error between the sampled and quantized state qa;{t) and the state x{t) 
at the present time. Sinee 

Vp,qix{t), q^{t)) = 2x{tyP{Ap + BpKq)x{t) + 2x{tyPBpKq{qyt) - x{t)), (8) 

we need to obtain a bound on the error qx{t) — x{t) by using x{t). We begin by examining the 
relationship among the state at the present time x{t), the sampled state x{[t]~), and the sampled 
quantized state qx{t). 


The partition {Qjjjes is finite. Furthermore, Assumption 2.3 shows that if there exists a 
sequenee C Qj sueh that ^ 0 (fc —)■ cxd), then Q{x) = 0 for all x E Qj. Henee there 
exists a eonstant oq > 0 sueh that 


\\BpKqQ{x)\\ < ao||a:| 


(9) 


for all p,q eV and x E 8p{R); see Remark 3.6 (3) for the eomputation of Oq. We also define 
A by 

A := max IIAoll. 

p&V ^ 

The next result gives an upper bound of the norm of the sampled state a;([f]“) by using the 
state at the present time x{t). 

Lemma 3.1: Consider the switheed system ([T]) with Q, where a has finitely many switehing 
times in every finite interval. Suppose that 

e" 


V ■= tto- 


AT, _ I 

T 


< 1, 


( 10 ) 






and define ai by 




«! := 


( 11 ) 


Then we have 


|a;([t] )|| < Q!i||a;(t)| 


( 12 ) 


for all t > 0 with a;([t]“) G Sp{R). 

Proof: It suffices to prove ( fT^ for a:(0) e Sp{R) and f G [0,Ts). 

Let $(ri,r 2 ) denote the state-transition matrix of the switched system ([T]) for ti > T 2 . If no 
switches occur, <L(ri,r 2 ) is given by ^{ti,T 2 ) = If tiR 2 ,... ,tm are the switching 

times in an interval (^ 2 , ri) and if we define R '■= T 2 and tm+i ■= ti, then we have 

m 

$(ri,r2) = 

k=0 


Since 


a;(t) = $(f, 0)a;(0) + / ^{t,T)B„^r)K^^o)q^{T)dT 


(13) 


and since <I)(r, 0) ^ = <I)(f, 0) ^<L(f, r), it follows that 


x(0) = ^(f, 0) ^x{t)+ / <I>(r, 0) ^B^(^r)Ka{ 0 )qx{T)dT. 


This leads to 


|x(0)||<||«I>(f,0)-^||-||a;(f)|| + 


<T(r,0) 5^(^)iT^(o)gx(r)dr 


(14) 


Let ti,t 2 , • • • be the switching times in the interval [0,f). Since ||e’'"^|| < for r > 0, if 
we define to := 0 and tm+i ■= t, then we obtain 


||*1’(^, 0) ^11 < < gAi <- gAr,,_ 


(15) 


k=0 


It is obvious that the equation above holds in the non-switched case as well. Since qxi^) = 
?x(0) = Q(x(0)) for all r G [0,Ts], if follows from Q that 

^ ^{T,0)~^B„^r)K^(^o)qx;{T)dT < [ ■ \\B„^r)Ka(0)qx{r)\\dT 


>0 


<ao dT\\x{R)\\ 

Jo 

- ^0 ^ A ^ ^11^(0)11- 


(16) 












Substituting ( [T5] ) and ( fT^ into 0. we obtain 


x(0)|| < e^^'’||x(t)|| + 77||a;(0)||. 


Thus if ( fT0| ) holds, ( [T^ follows. ■ 

Let us next develop an upper bound of the norm of the error x{t) — x([f]“) due to sampling. 
To this end, we use the following property of the state-transition map of a switched system: 

Proposition 3.2: Let 0) be the state-transition map of the switched system ([T]) as above. 
Then 

||$(t,0)-/|| (17) 

Proof: Let us first consider the case without switching; that is. 


|gi^<T(0) _ /|| < gAi _ X. 


(18) 


Define the partial sum Sn of — / by 


TV TV 


k=0 


k=l 


Then for all f > 0, we have 


k=l 

= Em 

k=0 


1 


<E«(‘M 


k=0 


1 , 7 ( 0 ) 


-1 


= g*ll^cr(0)ll _ X < — 1 


Letting N ^ oo, we obtain ( [18] ). 

We now prove ( [TT] ) in the switched case. Let ■ ■ ■ ,tm be the switching times in the 
interval (0,f). Let fo = 0 and tm+i = t. Then ( [T7] ) is equivalent to 


m 

g(ifc + l~^fc)^cr(t^) _ J 

k=0 


< e^* - 1. 


(19) 









We have already shown ( [T9| ) in the case m = 0, i.e., the non-switched case. The general case 
follows by induction. For m > 1, 


g(^fe + l ^k)^rT(tj.) _ J 

g(im + l —j g(^fc + l ) J 


< 


^ m—1 


k=0 

m—1 


||g(^m + l II . 


JJ' g(4+i-4)-4^(tj,) _ J 


k=0 


T _ /|| 

_j_ ||g(*m+l“*m,)^CT{tm,) Jll 


Hence if ( [T9l ) holds with m — 1 in place of m, then 


^(im + l II . 


m—1 


jj" g(4+i-4)^a{tj,) _j 


fc =0 


_j_ I|g(*™ + 1 *™)^o-(tm) —J|| 


g^(im + l im)^gAtm _ _j_ ^gA(tm+l tm) _ 

= - 1 . 

Thus we obtain ( [T9l ). ■ 

Lemma 3.3: Consider the switched system ([T]) with Q, where a has finitely many switching 
times in every finite interval. Define /3i by 


ft := - 1) (l + ‘^) 


Then we have 


\x{t)-x{[t] )|| </?i||a;([f]- 


( 20 ) 


( 21 ) 


for all f > 0 with x{[t] ) G Sp{R). 


Proof: As in the proof of Lemma 3.1 it suffices to prove pT] ) for all x(0) G £p{R) and 
t G [0,T,). 

By ( [T3] ), we obtain 


x{t) - x(0) = (<f)(f, 0) - /)x(0) + / <f)(f, T)B„^^)K„i^Q)q^{T)dT. 

Jo 


This leads to 


|x(f) -a:(0)|| <||$(f,0) -/|| ■ ||a:(0)|| + 


$(f, T)B„f^r)K„(^)qx{T)dT 


( 22 ) 
























Proposition |3.2| provides the following upper bound on the first term of the right-hand side of 


||$(t,0)-/|| < - 1 < - 1. 

Since ||<f)(f, r)|| < a calculation similar to ( [T^ gives 


$(f, T)B^^r)Ka(o)qx{T)dT 


.at; 


< tto- 


- 1 , 


A 


^(0)||. 


(23) 


(24) 


We obtain pT] ) by substituting ( [23] ) and p4| ) into pi] ). ■ 

We are now in the position to obtain an upper bound of the norm of the error qx{t) — x{t) 
due to sampling and quantization by using the original state x{t). 

Similarly to to each p,q e V with p ^ q, there corresponds a positive number 7 o(p, g) 
such that 


\PBpKg{Q{x) - x)\\ <7o{p,q)\\x\ 


(25) 


for all X E Sp{R); see Remark 3.6 (3) for the computation of 70 . 

Lemma 3.4: Consider the switched system ([T]) with p]), where a has finitely many switching 


times in every finite interval. Define ai and /)i as in Lemmas 3.1 and 3.3 If 'yip^q) is defined 
by 


7(p,g) := ai{Pi\\PBpKg\\ +7o(p,g)) 

for each p,q eV with p q, then 7 (p, q) satisfies 

\\PBpKq{qx{t) -a:(f))|| < 'y{p,q)\\x{t)\\ 
for all f > 0 with a;([f]“) G Sp{R). 


(26) 


(27) 


Proof: Since q^it) = Q{x{[t] )), it follows from pT] ) and p5] ) that 

\\PBpKg{qx{t)-xm\ < \\PBpKgiqx{t) - x{[t]-))\\ + \\PBpKg\\ ■ ||a:([f]-) - a;(f)|| 

< Wi\\PBpKq\\ +7o(p,g))||x([f]“)|| 

< ai{/3i\\PBpKq\\ +7o(p,g))||a;(f)||. 


Thus the desired inequality p7] ) holds. ■ 

Finally, the following theorem gives the growth rate of V in the case when the modes of the 
plant and the controller are not synchronized. 

















Theorem 3.5: Consider the switched system ([T]) with Q, where a has finitely many switching 
times in every finite interval. Using 7 (p, q) in ( |2^ , we define D by 


D := 2mM\\P{Ap + BpKq)\\ +7(p,g)). 

prq 

Then Q holds for every p,qeV with p ^ q and for every f > 0 with x{[t]~) G £p{R). 
Proof: Since Vp^q satisfies Lemma 


(28) 


3.4 


shows that 


< 2 (||P( 2 lp + Spit:g)|| +-f{p,q))\\x 


(29) 


for all p,qeV with p ^ q and for all f > 0 with x{[t]~) G £p{R). Thus we obtain the desired 
result 0 . ■ 

Remark 3.6: (1) Fine quantization and fast sampling make ai in ( [TT] ), j3i in ( [^ , and 7 o(p, q) 


in (25) small, which leads to a decrease of D in (28). 


(2) In this subsection, we have assumed that finitely many switches occurs in a sampling 
interval, which makes ( [T5] ), ( [23] ), and ( |24j ) conservative. If we allow a higher computational cost, 
then another possibility of ai in ( [TT] ) and /3i in ( [20[ ) under Assumption [2.2[ would be 




ai = max max max -7-^ 

0<t<T,0<t'<t ^ ||e-Ar||rfrj 

A = max max max I +ao( f 

p^q 0<t<Ts0<t'<ty Jq 

where t' is a switching time in [ 0 ,f]. 

(3) We can derive cto in ([^ and 70 (p, q) in ( [25] ) as follows. Let 5/ be a subset of S such that 
£p{R) C Qj- Then 


ao := max max 


WBpKqqqW 


p,q&v jeSf ||a:|| 

satisfies 0 . Note that if Qj is a polyhedron, then min^-gg^ ||a:|| can be computed by quadratic 
programming; see, e.g, [1]. As regards 7o(p, O') in ( [25] ), define Sq := {j E S ■. 0 G Cl(Qj)}. 
Since Q{x) = 0 for x G Qj with j G Sq by Assumption [2.3[ it follows that 70 (p, q) > \\PBpKq\\. 
On the other hand, for j ^ Sq, we define 7o by 

\\PBpKq\\ ■ maXa;6Q^. \\qj - x|| 


7o(p,g):= niax 
jeSf\So 


||a;| 













Since 


\PBpKq\\ ■ max^sgj hj - 3:|| ^ \\PBpKg\\ ■ \\qj 


x\ 


mina;6Q. ||x| 


Uc 


> 


\PBpKg{qj - x)\\ 


\x\ 


7 o(p, g) := max{IIII, 7o(p, g)} satisfies ( |25] ). We ean easily compute maXa,gQ^^ \\qj — x|| 
if Qj is a euboid and qj is a eenter of a vertex of Qj. In fact, let the set of the vertiees of Qj 
be Vj. Then max^-gQ^- \\qj — x|| = max^-gv^ ||gj — a;||, whieh implies that max^-gQ^. \\qj — a;|| can 
be obtained by calculating ||gj — n|| for all v eVj. 


B. Stability analysis with total mismatch time 

Let us analyze the stability of the switched system ([T]) with ([^ by using the two upper bounds 
@ and 0 of V. Note that the former bound Q is for the ease a{t) = o'([f]“), while the latter 
0 for the case a{t) ^ o'([t]“). As in [20] for switehed systems with time delays, it is therefore 
useful to characterize switching signals by asynchronous periods. 

Definition 3.7: For ti> T 2 > 0, we define the total mismateh time /i('ri,r 2 ) by the time in 
whieh the modes mismatch between the plant and the eontroller, that is. 


;= the length of the set {r e [t 2 ,Ti) : a^r) ^ o-([r]")}. (30) 

More explicitly, the length of a set in M means its Lebesgue measure. We shall not, however, use 
any measure theory beeause a has only finitely many discontinuities in every interval. We see 
that if the total mismatch time is small on average as the average dwell-time condition introduced 
in [7], then the system is stable. We also derive an ultimate bound on the state trajeetories by 
using this characterization of switching signals. 

Define Cp and Dp hy 


Cp := 


C 


Dp := 


D 


Amax(7^)’ Amin(7^) 

The objective of this subsection is to prove the following theorem: 

Theorem 3.8: Let Assumptions |2.1[ |2.2[ |2.3[ and 2.4 hold. Suppose that L > 0 satisfies 

Cp 


L < 


Cp -\- Dp' 


(31) 


and that n > 1 satisfies 


< P^Amax(^)- 


( 32 ) 














Define /(k) by 


/(«^) := 


21ogfi: 
Cp + Di 


If /i in (30) satisfies 


/i(t, 0) < Lt 

for every f > 0, and for each Tq > 0 with a(To) ^ cr([To]“) 

Tq) < /(k) + L{t — Tq) 


(33) 


(34) 


(35) 


for every t > Tq, then there exists > 0 such that for each a:(0) G Int {£p{R)) and cr(0) G V, 
x{t) G Int {^p{K,r)) for all t > T^. Furthermore, x{t) G Int {£p{R)) for all t > 0. 


Remark 3.9: (1) Theorem 3.8 gives the stability analysis of the switched system by using the 
total mismatch time of the modes between the plant and the feedback gain. If a mismatch does 
occur, the closed-loop system may be unstable-, otherwise it is stable. Our proposed method is 
therefore similar to that in [40], where the stability analysis of switched systems with stable and 
unstable subsystems is discussed with the aid of the total activation time ratio between stable 
subsystems and unstable ones. In [40], the average dwell time [7] is also required to be sufficiently 
large. However, such a condition is not needed here because we use a common Lyapunov 
function. Conditions on the total activation time ratio has been used for nonlinear systems in 
[22], [23], [38]. Moreover, this switching characterization has been applied to stabilization of 
systems with control inputs missing in [41] and to resilient control under denial-of-service attacks 
in [2]. 

(2) Although Theorem 3.8 requires that ( [35] ) holds for each Tq > 0 with cr(To) ^ ct([To]“), it 
is enough to verify ( [^ only with the sampling instant [Tq]” + Tg in place of Tq. In fact, since 


at most one switch occurs in [[Tq] , [Tq] + T^), it follows that if ct(To) ^ o'([To] ), then 

bi'ty [^o] + Tg) = Tq) — ([Tq] + — Tq). 


Hence ( |35] ) holds for t > Tq if it does for t > [Tq]” + Tg. 

First we study the state behavior that is outside of £p{r). The following lemma shows that 
every trajectory whose initial state is in Int {£p{R)) falls into £p{r) if the total mismatch time 
/i is small on average. See also Fig. 







Lemma 3.10: Let Assumptions |2.1[ |2.2[ |2.3[ and 2.4 hold, and let L > 0 satisfy ( [3T] ). If 
0) achieves ( [34l ) for all t > 0, then there exists > 0 such that x{Tr) G £p{r) for every 
a;(0) G Int {Sp{R)) and cr(0) G V, and furthermore x{t) G Int {Sp{R)) for all t G [0,Tr]. 

Proof: First we show that the trajectory x{t) does not leave Int {£p{R)) without belonging 
to ^p(r). Namely, there does not exist Tp> 0 such that 


x{Tr) G d£p{R), and 
x(t) G Int {£p{R)) \ £p{r) (0 < f < Tr). 


(36) 

(37) 


Assume, to reach a contradiction, ( |36| ) and ( |37| ) hold for some Tp > 0. Recall that 

Amin(P)|kiP < V{X) = X'^PX < A^ax(P)||xiP 
for a: G M". It follows from (|^ and Q that 

Vp{x{t),q^{t)) < -CpV{x{t)) 
yp,q{^{t),qx{t)) < DpV{x{t)). 


(38) 


By pT] ) and ( |38] ), a successive calculation at each switching time shows that 

V{x{Tr)) < exp {Dpfi{TR,0) - Cp{Tp - fi{Tp,0)))V{x{0)). 


(39) 


(40) 


Since ( p4l ) gives 

i9p/i(f,0) — Cp(t — /i(f,0)) < (^(^Cp Dp') L — Cp') t 
for all f > 0, it follows from ( |3T] ) and a;(0) G Int {Sp{R)) that 

V{x{Tr)) < V{x{0)) < i?'A„ax(P). 

However, shows that V{x{Tr)) = i?^Amax(-P), and we have a contradiction. 

Let us next prove that x{Tr) G ^p(r) for some Tr > 0. 

Suppose x{t) ^ ^pir) for all f > 0. Then since the discussion above shows that x{t) G 


Int {8p{R)) \ Sp{r) for all f > 0, we obtain ( |39l ) with arbitrary f > 0 in place of Tr. Hence 
and ( |40| ) show that V{x{t)) — 0 as f —)■ oo. However, this contradicts x{t) ^ ^p(r), i.e., 
V{x{t)) > r^Aniin(-P) > 0. Thus there exists Tr >0 such that x{Tr) G ^p(r). ■ 

From the next result, we see that the trajectory leaves £_p{r) only if a switch occurs between 
sampling times. This is intuitively obvious because as mentioned in [8], £p{r) is an invariant 
set if a mode mismatch does not occur. 
















Lemma 3.11: Let Assumptions |2.1[ [2^ |2.3[ and 2.4 hold. If the trajectory x{t) leaves ^p(r) 
at t = To, more precisely, if there exists <5 > 0 such that 


x(To) e d£p{r), x(To + e) ^ £p{r) (0 < e < 5), (41) 

then a(To) ^ a([To]-). 

Proof: Assume, to get a contradiction, that ct(To) = (t([To]“). Suppose that ct(T) ^ cr([T]“) 
for some T > Tq. Let Ti be the smallest number of such T. Define an interval Is by 


h := (0, min{(5, Ti - Tq}). 

If there does not exist T > Tq with cr(T) ^ cr([T]“), then we define Is by Is := (0,5). Since 
V{x{t)) is differentiable at all f > 0 except for sampling times and switching times, there 
is no loss of generality in assuming that V{x{t)) is differentiable in Is- Since cr(To + e) = 
cr([To + e]“) = cr([To]“) for all £ G J^, it follows from @ that 

V{x{To + £)) < -C'||a;((To + £))||' < 0 (e G h). 

However, gives 

V{x{To + £)) > = V{x{To)) {e G Is). 


Since V{x{t)) is continuous, we have a contradiction by the mean value theorem. Thus cr(To) ^ 
■^dTo]-). ■ 


Lemma 3.12 below shows that the trajectory stays in a slightly larger ellipsoid than £p{r) 
after the trajectory enters into £p{r); see Fig. 

Lemma 3.12: Let Assumptions |2.1[ |2.2[ |2.3[ and 2.4 hold. Suppose that Tq > 0 is a time at 
which x{t) leaves £p{r). Let k> 1 satisfy ( [^ and define /(k) by ( |^ . Pick T > 0 with ( [3T| ). 
If /i(f, To) satisfies ( [35| ) for all t > Tq, then for every ct(To) G V, there exists Ti > Tq such that 
x{Ti) G £p{r), and furthermore x{t) G Int {£p{Kr)) for all t G [To,Ti]. 

Proof: By ([35]), V{x{t)) satisfies 


V{x{t)) < exp ( {{Cp + Dp)L- Cp) {t - To)) ■ exp ( {Cp + Dp) f{K))V{x{n)) (42) 


if f > To satisfies x{t') G £p{R) \ £p{r) for all t' G (To,f]. On the other hand, since a;(To) G 
d£p{r), it follows from ( |3^ that 

exp ( {Cp + Dp) f{K))V{x{To)) = K^r^X^ainiP)- 


(43) 













Fig. 2: Behavior of trajectory 


In conjunction with ( plj ), this leads to 

exp ( {Cp + Dp) f{K))V{x{To)) < i? 2 An,ax(P). 

Hence we have x{Ti) G £p{r) for some Ti > Tq from ( [3T] ) and ( |42| ) as in the proof of Lemma 

, we also obtain V{x{t)) < K^r'^Xj^miP) ^r t > Tq. Thus 


3.10 Substituting ( |43| ) into 

x{t) G Int {Sp{Kr)) for t G [To,Ti]. 


Finally, we prove Theorem 3.8 by using Lemmas 3.10 3.11 and 3.12 


Proof of Theorem 3.8: Lemma 3.10 shows that if ([34|) holds for alH > 0, then x{Tr) G £p{r 


for some > 0 and x{t) G Int {£p{R)) for all t G [0, T^]. Let ri, r 2 , ... be the instants at which 
x{t) leaves £p{r). Using Lemmas 3.11 and 3.12| at each Ti,T 2 , ..., we have that if for each 
To > 0 with (j(To) 7^ cr([To] ), ( |35] ) holds for every t > Tq, then there exists fk G (rfc, such 
that x{fk) G £p{r) and x{t) G Int {£p{K,r)) for all t G [Tk,Tk+i]. Hence if {xk} has only finitely 
many elements, then the stability is achieved. On the other hand, if we have infinitely many r^, 
then Tfc —>■ cxD as fc —)■ oo, because Tk +2 — Tk>Ts by the switching condition in Assumption |2.2[ 
Thus x{t) G Int {£p{n,r)) for all t > Tr. This completes the proof. ■ 

IV. Reduction to a Dwell-Time Condition 

In the preceding section, we have derived a sufficient condition on the total mismatch time p 
for the stability of the quantized sampled-data systems with multiple modes. However, it may 
be difficult to check whether p satisfies ([34|) and (|35]). In this section, we will show that these 


conditions ([34|) and ([35|) can be achieved for switching signals with a certain dwell-time property. 






















To proceed, we reeall the definition of dwell time: We eall a a switching signal with dwell 
time Td if the switehing signal a has an interval between conseeutive discontinuities no smaller 
than Trf > 0 and further if a has no diseontinuities in [0,Trf). 

The following proposition gives an upper bound of the total mismateh time for switehing 
signals with dwell time. 


Proposition 4.1: Fix n E N. For every switehing signal a with dwell time riTg, /i in ( |30| ) 
satisfies 


t 


0) < — (f > 0). 


n 


Furthermore, if ct(To) ^ cr([To] ), then 

dity Tq) < Tg + 


t — Tn 


n 


{t > To). 


(44) 


(45) 


Proof: The proof ineludes a lengthy but routine ealeulation; see Appendix A.l. ■ 

Theorem 3^ and Proposition |4.1| ean be combined in the following way: 

Theorem 4.2: Let Assumptions |2.1[[T^|2.3[ and 2.4 hold. Let n G N satisfy n > 1+Dp/Cp. 
Define 

'T,{Cp + Dp)' 


K := exp 


(46) 


and suppose that k satisfies ( [32[ ). If the dwell time of a is nTg, then there exists > 0 sueh that 
for every a;(0) G Int {Sp{R)) and cr(0) G V, x{t) G Int (Spinr)) for all t > Tr. Furthermore, 
x{t) G Int {Sp{R)) for all t > 0. 

Proof: If n and k are defined as above. Proposition |4.I| shows that fi satisfies ( [^ and ( |^ 


for every switehing signal a with dwell time nTg. Henee the eonelusion of Theorem 3.8 holds. 


The next result implies that the upper bounds obtained in Proposition 4.1 are elose to the 


supremum over all switehing signals with dwell time nTs if the sampling period Tg is suffieiently 
small. 

Proposition 4.3: Fix £ > 0 and n G N. For any T > 0, there exist a switehing signal a with 
dwell time nTg and t >T sueh that 

0 ) > - - 1 ^— + £ 
n \ n 

























Furthermore, for any T > 0, there exist a switehing signal a with dwell time nTg, Tq > 0 with 
u{Tq) 7^ (t([To]“), and t > Tq + T such that 

f^(t, Tq) >Ts-\ - ( -h . (47) 

n \n J 

Proof: This is again a routine calculation; see Appendix A.2. ■ 

The next result is the case n = 1 in Proposition |4.3[ 

Corollary 4.4: There exist a switching signal a with dwell time Tg such that /i(t, 0) ~ f for 
sufficiently large f > 0. 

This corollary shows that, not surprisingly, if the dwell time does not exceed the sampling period, 
then the information on switching signals is not so useful for the stabilization of the sampled-data 
switched system. 


V. Numerical Example 


Consider the switched system with the following two modes: 


1 

1 

-2 

1 

-4 

Ai = - 
6 

-3 

2 

, Bi = - 
’ 6 

3 



1 -5 


1 

A 2 — 

1 2 

, B2 = 

-1 

T—1 

1 


The state feedback gains Ki and K 2 are given by 


Ki = 


1.38 -l.f 


K. = 


-2.80 3.77 


(48) 


We computed the above regulator gains by minimizing the cost 

[x{t)~^x{t) +u{ty)dt. 

Note that both Ai + B 1 K 2 and A 2 + B 2 K 1 are not Hurwitz: Ai + B 1 K 2 has one unstable 
eigenvalue 4.4538 and A 2 + B 2 K 1 has two unstable eigenvalues 1.4091 and 4.7750. 

The sampling period T* was given by T* = 0.025, and we used the following logarithm 
quantizer: Let the state x be x = [xi X2]^. For a nonnegative integer n, the quantized state 
Q{x) = [Qi(xi) Q 2 {x 2 )Y is defined by 

' zMnl+ifAAl 

2 

0 

go(>?"+<+i) 





2 


<Xi< -^ovY 

(-^0 <Xi< ^ 0 ) 

YqT]^ <X < 





















where .^o = 0.08 and rj = 1.2. 

Set C = 1, R = 68.6, and r = 0.175 in Assumption |2.4[ Algorithm 1 1.1 1 of Appendix B gave 
the positive definite matrix P in Assumption |2.4| by 


P = 


2.9171 0.3489 
0.3489 3.6256 


In the randomized algorithm, we used 10^ samples in state for each run, and five samples in 
time for each sampled state. We stopped the algorithm when there was no update for an entire 
run. 


are n = 76 and k = 1.2864. 

A time response (0 < f < 20) was calculated for (t( 0) = 1 and some initial states on 
d£p{R — e) with e = 0.001. Fig. [^depicts the state trajectories x of the switched system 0 
with dwell time 76Ts = 1.9. After an interval of length 76Ts with no switches, a switch of the 
plant mode occurs with probability 0.05 per sampling interval and the distribution is uniform 
in a sampling interval. The blue line indicates that the feedback gain designed for the active 
subsystem was used, i.e.. 


Since we obtain D = 55.15 in (|7]) from the data above, the resulting n and k in Theorem 4.2 


or {A 2 , B 2 , K 2 ). 

The red line shows that a switch led to the mismatch of the modes between the plant and the 
feedback gain, i.e.. 


(^(T(t), A'o-([t]-)) — (Ai, Bi, K 2 ) or {A 2 , B 2 , Ki). 

The black lines in Fig. [^represent the ellipsoid of initial conditions Sp{R) and the attractor set 
Spinr), respectively. 

Here we see two conservative results: the dwell time 76Ts and the attractor set £p{Kr) in 


Fig. 3b Since we evaluate the increasing and decreasing rates of the Lyapunov function only by 
0 and the switching condition for stability becomes conservative. In particular, we need to 
refine the upper bound Q in the mismatch case, which has been obtained by assuming that we 
have the worst-case trajectory whenever a mode mismatch occurs. If we know where switching 
happens as for piecewise affine systems, then the upper bound Q can be improved. 






1.0 




Xi 


(a) Region [-80, 80] x [-75, 75] 


(b) Region [-0.75,0.75] x [-1.0,1.0] 


Fig. 3: The trajectories x with ct(0) = 1 


As regards the attractor set Sp{Kr), the trajectories in Fig. [^stayed in a smaller neighborhood 
of the origin. The conservative result is also due to the upper bound Q; see ( [4^ . Another reason 
is the nonlinearity of static quantizers and this conservatism is observed for systems with a single 
mode as well [5], [8], [9]. Construction of polynomial Lyapunov functions may allow us to obtain 
less conservative bounds. 

If we use multiple Lyapunov functions together with an average dwell-time property, instead 
of a common Lyapunov function, then the above conservatism can be reduced. On the other 
hand, the authors of [6] have proposed the calculation method of an ultimate bound and an 
invariant set for continuous-time switched systems with disturbances. If one can generalize this 
method to sampled-data switched systems with a static quantizer, then another insight into the 
state trajectory near the origin will be obtained. Details, however, are more involved, so these 
extensions are subjects for future research. 











VI. Concluding Remarks 


For sampled-data switched systems with static quantizers, we have developed a stability analy¬ 
sis by using a common Lyapunov function computed efficiently from a randomized algorithm. We 
have derived a switching condition on the total mismatch time, and have found a neighborhood 
of the origin into which all trajectories fall whenever the initial state is within a known bound. 
Moreover, the condition on the total mismatch time has been reduced to a dwell-time condition. 
Future work will focus on improving the upper bound on the growth rate of the Lyapunov 
function in the mismatched case, and analyzing the stability by multiple Lyapunov functions 
and an average dwell-time property. 


Appendix 


A. Proof of Proposition 4.1 


Let us first prove ( |4^ . It is clear that /i = 0 if a has no discontinuities in the interval (0,t). 
Let ti,... be the switching times in (0,f). We have 

[tk\~+Ts-tk 

0 otherwise 


p{[tk+i] , [4] ) = 
for A; = 1,..., m — 1, and 


[tm] ) ^ 


[tm] “f Tg tm if tm f [fm] and \trn\ Tg ^ t 

1 Im if fm f \pm\ and \trn\ Tg ^ t 

0 otherwise 


Since t > mnTs, we obtain 


0) < V'([4] +Ts- 4) < rnTs < -t. 

^^ n 


k=l 


Hence (44) holds. 


Next we show ( |45| ). Since u{Tf) (t([To]“) and since the dwell time is riT* > T^, it follows 
that cr has precisely one discontinuity in the interval ([To]“,To]. Let us denote the switching 
time by to. 

Suppose that no switches occur in the interval (Tq, t). Since only the interval [Tq, [Tq]” -f Tg) 
has a mode mismatch, it follows that 


Tq) < [Tq] + Tg — Tq < Tg, 








and hence (45) holds. 


Suppose that m switches occur in the interval (Tq, t), and let ti,... ,tm, be the switching times. 
Define by 

Cfc • (f'fc+i f'fc) 


(49) 


for fc = 0,..., m — 1. The dwell-time assumption implies that > 0. We also have 


m—1 


t-To = {t-t„,) + ^(4+1 - 4) - {To - to) 

k=0 

m—1 

= {t- tm) + ^(4 + nTg) - {To - to) 
k=D 

m—1 

= mnTs + {t - tm) + {To - to). 

We split the argument into two cases: 

{t — tm) + ^To — to 


k=0 


(50) 


m—1 


and 


A:=0 

m—1 


{t - fm) + ^ 4 < ^0 - to- 


(51) 


(52) 


fc =0 


First we study the case ( [51] ), where some switching intervals are sufficiently larger than nTg. 
Combining ( [5T] ) with ( |50l ), we obtain t — To > mnTs, and hence 

m 

/^(^) 2o) < ([2o] T Tg — To) + y~~^([tfc] T Tg — tk) 

k=l 

< (m + l)Ts <Tg + -{t - To), 
n 


which is a desired inequality (45). 


Let us next consider the case (52), where every switching interval is smaller than nTg. Since 


m—1 


fi{t, To) = /i([4] , To) + ^ /i([4+i] , [4] ) + fJ-{t, [tm] ) 

k=l 

and since /i([fi]“, Tq) = ^{[To]~ +Tg, Tq) < [Tq]” — Tq, it is enough to obtain upper bounds 

on /i([4+i]-, [4]-) and /i(f, [tm]~). 

We first derive 

/i([4+i]“, [4]“) < [4]“ +Tg-to (53) 













for fc = 1,..., m — 1 as follows. Since Yl'k=Q < Tq by ( |5^ , each switching time 4 {k = 
1,..., m) satisfies 

tk — to = [tk — ffc-l) + ■ ■ ■ + (^1 ~ ^o) 
k-l 

l=Q 

m—1 

< ^ + knTs 

1=0 

< To — to + knTg. 

In conjunction with the assumption on the dwell time, this leads to 

to + knTs <tk <To + knTs (54) 

for every fc = 1,..., m. Since 

[^o] = [^o] < to ^ Tq < [To] + Ts, (55) 


( |54l ) shows that [tk] = [to] + knTg, and hence 

to + knTs <tk< [tk]~ +Ts = [fo]“ + knTs + T*, 
which gives [tk\~ + Ts — < [fo]~ +Ts — to. We therefore have 

/i([4+i]", [4]") = k^i[tk]~ + Ts, [tk]~) 

^ [4] + Ts — 4 

^ [^o] +Ts — to- 


Thus we obtain ( |53l ). 
Similarly, we can obtain 


/i(f, [tm] ) < To - to. 


In fact, (52) and (49) give 


m—1 


t < {To- to) +tm-'^^k=To + mnTs. 


(56) 


k=0 


If we combine this with t > tm and (54), we see that 








which implies that 


We therefore have 


Kt, [tm] ) <t-tm <To-to. 


Sinee t — tm > 0 and > 0, it follows from ( pOl ) that m satisfies t — to > mriTg, i.e., 

t-to 


m < 


riT, 


By ( [5^ , ( [56| ), and ( [57| ), we have 

< ([To] +Ts — To) + (m — l)([fo] + — tg) + (To — tg) 

t — tg [to] +Ts — tg 


< 


n 


T. 


< 


t - [^o]' 


n 


Moreover, (55) gives 


rj, ^ t-Tg _ t - [to] ^0 ~ [^o]" 


n 


n 


n 


T. 


> T, - — > 0. 
n 


Hence (45) follows from (58). 


( 57 ) 


(58) 


B. Proof of Proposition 4.3 


Fix T > 0 and suppose that m G N satisfies mnTs > T. 

To prove the first assertion of the theorem, let a switehing signal a have diseontinuities at 
knTs + e/m (A; = 1,..., m). If we define t := mriTg + Tg, then t >T and we obtain 

/i(f, 0) = m (Ts - —) = mTs - e = - - (—+ e 
\ m/ n \n 

To prove the seeond assertion, let To — [To]“ = e/(2m + 1) and let a have a switeh at 
Tg + kriTg + = [To]“ + knTg + 


2(m + 1) m + 1 

for eaeh /c = 1,..., m. If we set f := To + mnTg + Tg, then f > Tq + T and we have 

a(t, Tg) = ( Tg -;-r ) + m ( Ts- 

V 2(m +1); V +1 


> (m + l)Ts — £ 


= Tg 


t — Tg 


n 


-+c|. 

n 





















which is the desired inequality (|47]). 

The randomized algorithm for the computation of P in Assumption |2.4| is summarized here 
for the sake of eompleteness. 

For a square matrix X G we denote its Frobenius norm by ||X||^ = fc=i 

where Xi^k is the {i, /c)-th entry of X. For X = X~^ G let its eigenvalue decomposition be 
X = , where U is orthogonal and S = diag(Ai,..., An). For a fixed 7 > 0, define : = 

diag(max{Ai, 7 },... ,max{An, 7 }) and set := , where 7 := [(5^ — 

for some 5 > 0. 

For the eonstruetion of common Lyapunov funetions, we use a seheduling funetion h : V 

that has the following revisitation property [15]: For every element i G V and for every integer 
I G there exists an integer k > I such that h{k) = i. 

We ean eonstruet the eommon Lyapunov funetion in Assumption |2.4| by using the randomized 
algorithm of [8], whieh is based on the gradient method proposed in [28]. 

Algorithm 1.1: (1) Piek an initial > 0 and set Ro,ro,6 > 0, and 5i G (0,5). 

(2) Find a finite index subset Sn of S sueh that B{Rq) C Uje5jv 

(3a) Set A := Ah{k), B := Bh(k), and P := Kh(k), and define 



■.= Kqj 

v{P,x,j,t) := {A4>{x,Uj,t) + BujYP(f){x,Uj,t) 

+ (j){x,Uj,ty P{A(l){x,Uj,t) + Buj) + C\\(j){x,Uj,t)\\‘^ 
Xpv{P,x,j,t) := {A(l){x,Uj,t) + Buj)(f){x^UjRY + 0(x,M j, f)(A0(a;,f) + BujY 
Xp{u) := {x G M" : (Ax + Bu)^Px + x^P{Ax + Bu) < —G||x||^}. 


(3b) Generate 


(xW, j[^]) G {(x, j) : X G [Q, n (ai3(ro) U dB{Ro))] U {dQ, n B{R,)), j G S^} 


: P 


according to some density function satisfying fx,j{x,j) > 0 for all (x,j) G P. 






(3c) If e dB{ro) U dB{Ro), then set 


p)[A:+l,0] _ 


I Gs,s ,if ^ A’pife.oi (m^w) 

1 otherwise, 

where and is the step size given by 

^ ||Vx[M||| • 

(3d) If xt^] e dQj n B{Ro), then 

(i) generate C [ 0 ,T 5 ] according to some density function ft satisfying 

ft{t) > 0 for all t G [0, T^] with the indices in increasing order: 0 < < • • • < 

t[k,i-i] < 

(ii) if 7 ^ 0 and if (j){x^^\uj[k]R^’^’''^) G C\{Qj[k] fl B{Roy \ B{ro)), then set 
p[fc+i,o] _ p[k,z].^ otherwise set 


p[k,i+l] _ 


G5,5,(P[^’*l)-/u[^’*'Vx[^’*l if 0(x[^l,MiW,^'^’*^) ^Xp[KO]iUj[k])UB{Ro) 
p[^’*l otherwise, 

where := Vpv{P^’^’^\ x^’^f is the step size given by 


^ llVxMlII ’ 


(iii) set pl^+^’^^l = p[^A_ 


(4) Find P > 0 satisfying £^p[fc,o](P) C B{Rq) and obtain r > 0 satisfying Biro) C 
£p[kfi]{r) C £p[kfi]{R) if it exists. 

The major difference from the algorithm in [8] is the procedure (3a), where a scheduling 
function is used. Under assumptions similar to those in [8], we can show that Algorithm o 
gives a solution in a finite number of steps with probability one. Since this is an immediate 
consequence of [8], [15], we omit the details. 
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